Constructed model for micro-content recognition in lip reading based deep learning

نویسندگان

چکیده

Communication between human beings has several ways, one of the most known and used is speech, both visual acoustic perceptions sensory are involved, because that, speech considered as a multi-sensory process. Micro contents small pieces information that can be to boost learning Deep an approach dives into deep texture layers learn fine grained details. The convolution neural network (CNN) technique employed complementary model with micro hold achieve special In This paper proposed for lip reading system presented video dataset. receives (the English alphabet) in input recognize them, role CNN clearly appeared perform two tasks, first feature extraction second recognition implementation results show efficient accuracy rate various dataset contains variety reader many persons age range from 11 63 years old, gives high reach 98%.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Named Entity Recognition in Persian Text using Deep Learning

Named entities recognition is a fundamental task in the field of natural language processing. It is also known as a subset of information extraction. The process of recognizing named entities aims at finding proper nouns in the text and classifying them into predetermined classes such as names of people, organizations, and places. In this paper, we propose a named entity recognizer which benefi...

متن کامل

Learning Visual Models for Lip Reading

This chapter describes learning techniques that are the basis of a "visual speech recognition" or "lipreading" system 1 • Model-based vision systems currently have the best performance for many visual recognition tasks. For geometrically simple domains, models can sometimes be constructed by hand using CAD-like tools. Such models are difficult and expensive to construct, however, and are inadeq...

متن کامل

SQuAD reading comprehension deep learning model

We introduce a neural network model for reading comprehension using the SQuAD dataset. Our model is composed of a Dynamic Coattention Network encoder (Xiong et al. [2016]) and a novel decoder designed for runtime minimization. Our model obtained an F1 score of 52.283 when tested on the SQuAD dev set, and an exact-match score of 38.723.

متن کامل

Deep Learning for Lip Reading using Audio-Visual Information for Urdu Language

Human lip-reading is a challenging task. It requires not only knowledge of underlying language but also visual clues to predict spoken words. Experts need certain level of experience and understanding of visual expressions learning to decode spoken words. Now-a-days, with the help of deep learning it is possible to translate lip sequences into meaningful words. The speech recognition in the noi...

متن کامل

Efficient face model for lip reading

There is number of researches on the lip reading. However, there is little discussion about which face model is effect for lip reading. This paper builds various face models which changes the combination of a face part, and changes the feature points. Various experiments were conducted on the conditions which change only model and do not change other algorithms. We apply the active appearance m...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Bulletin of Electrical Engineering and Informatics

سال: 2021

ISSN: ['2302-9285']

DOI: https://doi.org/10.11591/eei.v10i5.2927